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Abstract. We show that every NP problem is polynomially equivalent 
to a simple combinatorial problem: the membership problem for a special 
class of digraphs. These classes are defined by means of shadows (pro- 
jections) and by finitely many forbidden colored (lifted) subgraphs. Our 
characterization is motivated by the analysis of syntactical subclasses 
with the full computational power of NP, which were first studied by 
Feder and Vardi. 

Our approach applies to many combinatorial problems and it induces 
the characterization of coloring problems (CSP) defined by means of 
shadows. This turns out to be related to homomorphism dualities. We 
prove that a class of digraphs (relational structures) defined by finitely 
many forbidden colored subgraphs (i.e. lifted substructures) is a CSP 
class if and only if all the the forbidden structures are homomorphically 
equivalent to trees. We show a surprising richness of coloring problems 
when restricted to most frequent graph classes. Using results of Nesetfil 
and Ossona de Mendez for bounded expansion classes (which include 
bounded degree and proper minor closed classes) we prove that the re- 
striction of every class defined as the shadow of finitely many colored 
subgraphs equals to the restriction of a coloring (CSP) class. 

Key words: digraph, homomorphism, duality, NP, Constraint Satisfac- 
tion Problem 

1 Introduction, Background and Previous Work 

Think of 3-colorability of a graph G. This is a well known hard (and a canonical 
NP-complete) problem. From the combinatorial point of view there is a stan- 
dard way how to approach this problem (and monotone properties in general): 

1 Part of this work was supported by ITI and DIMATIA of Charles University Prague 
under grant 1M0021620808, by OTKA Grant no. T043671, NK 67867, by NKTH 
(National Office for Research and Technology, Hungary), AEOLUS and also by Isaac 
Newton Institute (INI) Cambridge. 
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investigate minimal graphs without this property, denote by T the language of 
all such critical graphs and define the set Forb{T) of all structures which do not 
"contain" any F e T. Then the language Forb(T) coincides with the language 
of 3-colorable graphs. Unfortunately in the most cases the set T is infinite. How- 
ever the properties characterized by a finite set T are very interesting if we allow 
lifts and shadows. 

Let us briefly illustrate this by our example of 3-colorability. Instead of a 
graph G = (V, E) we consider the graph G together with three unary relations 
G\, C2, C3 (i.e. colors of vertices) which cover the vertex set V; this structure will 
be denoted by G' and called a lift of G (thus G' has one binary and three unary 
relations). There are 3 forbidden substructures: For each i = 1,2,3 the single edge 
graph K2 together with cover G\ = {1,2} and Cj — for j ^ i form structure 

(where the signature of F^ contains one binary and three unary relations). 
The language of all 3-colorable graphs is just the language <£>(Forb(F' l7 F 27 F' 3 )), 
where <P is the forgetful functor which transforms G 1 to G. We call G the shadow 
of G'. 

Clearly this situation can be generalized and one of the main results of this 
paper is Theorem 3 which states that every NP problem is polynomially equiv- 
alent to the membership problem for a class <J>{Forb{F')). Here T' is a finite set 
of (vertex pair)-colored digraphs, Forb{T') is the class of all lifted graphs G' for 
which there is no homomorphism F 1 — > G' for an F' G T' . Thus Forb(T') is 
the class of all graphs G' with forbidden homomorphisms from J 7 '. (See Section 
2 for definitions.) Theorems 4 and 5 provide similar results for forbidden colored 
subgraphs and for forbidden induced subgraphs (in both cases vertex colorings 
suffice). 

We should add one more remark. We of course do not only claim that every 
problem in NP can be polynomially reduced to a problem in any of these classes. 
This would only mean that each of these classes contains an NP-complete prob- 
lem. What we claim is that these classes have the computational power of the 
whole NP class. More precisely, to each language L in NP there exists a language 
M in any of these three classes such that M is polynomially equivalent to L, i.e. 
there exist polynomial reductions of L to M and M to L. E.g. assuming P ^ NP 
there is a language in any of these classes that is neither in P nor NP-complete, 
since there is such a language in NP by Ladner's celebrated result [14]. 

The expressive power of classes <P(Forb(J-')) corresponds to many combi- 
natorially studied problems and presents a combinatorial counterpart to the 
celebrated result of Fagin [4] who expressed every NP problem in logical terms 
by means of an Existential Second Order formula. 

The fact that the membership problem for classes <?(For6(J r ')) and their 
injective and full variants ^{ForbinjiF')) and ^(Forbfuii^')) have full compu- 
tational power is pleasing from the combinatorial point of view as these classes 
cover well known examples of hard combinatorial problems: Ramsey type prob- 
lems (where as in Theorem 3 we consider edge colored graphs), colorings of 
bounded degree graphs (defined by an injectivity condition as in Theorem 4) 
and structural partitions (studied e.g. in [8] as in Theorem 5). It follows that, in 
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the full generality, one cannot expect dichotomies here. On the other side of the 
spectrum, Feder and Vardi have formulated the celebrated Dichotomy conjecture 
for all coloring problems (CSP). 

Our main result is Theorem 9: we give an easy characterization of those 
languages $(Forb(f)) which are coloring problems (CSP). This can be viewed 
as an extension of the duality characterization theorem for structures [6]. We 
demonstrate the power of this theorem while reproving some theorems about 
the local chromatic number. In contrast with this we show that the shadow 
<P{Forb(F')) of a vertex colored class of digraphs Forb{!F') is always a CSP 
language when restricted to a bounded expansion class (this notion generalizes 
bounded degree and proper minor closed classes) [20] . Our main tools are finite 
dualities [23,6], restricted dualities [21], and the Sparse Incomparability Lemma 
[22, 9]. The detailed proofs can be found in the full version of this paper [13]. 

2 Preliminaries 

We consider finite relational structures although in most of the paper we only 
deal with digraphs, i.e. relational structures with just one binary relation. This 
itself is one of the main features of this note: oriented graphs suffice. Digraphs 
will be denoted by A, B, . . . (as we want to stress that they may be replaced by 
more general structures). 

Let r denote a finite set we refer to as colors. A r~ colored graph (structure) is 
a graph (or structure) together with either a coloring of its vertices or a coloring 
of all pairs of vertices by colors from r. Only in Theorem 3 we shall consider 
coloring of all pairs (but in Theorem 3 this will play an important role). Thus 
in the whole paper we shall undestand by a colored graph a graph with colored 
vertices. We denote colored digraphs (relational structures) by A',B' etc. Fol- 
lowing the more general notions in category theory we call A' a lift of A and A is 
called the shadow of A'. Thus (vertex-) colored digraphs (structures) can be also 
described as monadic lifts. A homomorphism of digraphs (relational structures) 
preserves all the edges (arcs). A homomorphism of colored digraphs (relational 
structures) preserves the color of vertices (pairs of vertices), too. The Constraint 
Satisfaction Problem corresponding to the graph (relational structure) A is the 
membership problem for the class of all graphs (structures) defined by {B : B is 
homomorphic to A}. We call a mapping between two (colored) digraphs a full 
homomorphism if in addition the preimage of an edge is an edge. Full homo- 
morphisms have very easy structure, as every full homomorphism which is onto 
is a retraction. The other special homomorphisms we will be interested in are 
injective homomorphisms. 

Let T' be a finite set of colored relational structures (digraphs). By Forb(F') 
we denote the set of all colored relational structures (digraphs) A' satisfying 
F' -/—^ A' for every F' £ T' . (If we use injective or full homomorphisms this will 
be denoted by Forbi n j(F') or Forbf u u(F'), respectively.) 

Similarly (well, dually), for the finite set of colored relational structures (di- 
graphs) V we denote by CSP{T>') the class of all colored digraphs A' satisfying 
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A' — > D' for some D' eV. (This is sometimes denoted by — > V.) Now suppose 
that the classes Forb{T') and CSPiV') are equal. Then we say that the pair 
[T' ,T>') is a finite duality. Explicitly, a finite duality means that the following 
equivalence holds for every (colored) relational structure (digraph): 

VF' e T' F' -f^ A' 3D' eP' A' — ► D'. 

We say that the structure A is core if every homomorphism A — ► A is 
an automorphism. Every finite structure A contains (up to an isomorphism) a 
uniquely determined core substructure homomorphically equivalent to A, see 
[23] [9]. The following result was recently proved in [6] and [23]. It characterizes 
finite dualities of digraphs (or more generally relational structures with a given 
signature). 

Theorem 1. For every finite set T of (relational) forests there exists (up to ho- 
momorphism equivalence) a finite uniquely determined set V of structures such 
that {T,T>) forms a finite duality, i.e. Forb{F) = CSP(T>). Up to homomor- 
phism equivalence there are no other finite dualities. 

Let <L> denote the forgetful functor which corresponds to a /'-colored relational 
structure (digraph) the uncolored one, i.e. it forgets about the coloring. We will 
investigate classes of the form (^(Forb^J 7 ')). We call the pair {T 1 ,T>) shadow 
duality if ^{Forb^ 1 )) = CSP(D). An example of shadow duality is the language 
of 3-colorable graphs discussed in the introduction (or, as can be seen easily, any 
CSP problem in general). Finite dualities became much more abundant when we 
demand the validity of the above formula just for all graphs from a given class K,. 
In such a case we speak about fC-restricted duality. It has been proved in [21] that 
so called Bounded Expansion classes (which include both proper minor closed 
classes and classes of graphs with bounded degree) have a restricted duality for 
every choice of T' . 

The study of homomorphism properties of structures not containing short 
cycles (i.e. with a large girth) is a combinatorial problem studied intensively. 
The following result has proved particularly useful in various applications. It is 
often called the Sparse Incomparability Lemma: 

Theorem 2. Let k,£ be positive integers and let A be a structure. Then there 
exists a structure B with the following properties: 

1. There exists a homomorphism f : B — ► A; 

2. For every structure C with at most k points the following holds: there exists 
a homomorphism A — ► C if and only if there exists a homomorphism 
B > C; 

3. B has girth > i. 

This result was proved by probabilistic method in [22] [24] , see also [9] . The 
polynomial time construction of B is possible, too: in the case of binary relations 
(digraphs) this was done in [18] and for relational structures in [12]. 
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3 Statement of Results 

3.1 NP by means of finitely many forbidden lifts 

The class SNP consists of all problems expressible by an existential second-order 
formula with a universal first-order part [4]. The class SNP is computationally 
equivalent to NP. Feder and Vardi [5] have proved that three syntactically defined 
subclasses of the class SNP still have the full computational power of the class 
NP. We reformulate this result to our combinatorial setting of lifts and shadows. 

Theorem 3. For every language L G NP there exist a finite set of colors r 
and a finite set of T -colored digraphs T' , where we color all pairs of vertices such 
that L is computationally equivalent to the membership problem for <P{Forb{!F')) . 

Theorem 4. For every language L € NP there exist a finite set of colors r 
and a finite set of T- colored digraphs T 1 , (where we color the vertices) such that 
L is computationally equivalent to the membership problem for ^(Forb in j (J 7 ')). 

Theorem 5. For every language L e NP there exist a finite set of colors r 
and a finite set of T- colored digraphs T' , (where we color the vertices) such that 
L is computationally equivalent to the membership problem for <&(F orb f u u (J 7 ')). 

3.2 Lifts and Shadows of Dualities 

It follows from Section 3.1 that shadows oiForb of a finite set of colored digraphs, 
this is classes <P(Forb(J-'')), where J-' is a finite set, have the computational 
power of the whole NP. What about finite dualities? Are the shadow dualities 
also more frequent? The negative answer is expressed by Theorem 7 and shows 
a remarkable stability of dualities. Towards this end we first observe that every 
duality (of lifted structures) implies a shadow duality: 

Theorem 6. Let F be a finite set of colors and T 1 a finite set of F -colored 
digraphs (relational structures), where we color all of the vertices. Suppose that 
there exists a finite set of T- colored digraphs (relational structures) V such that 
Forb(T') = CSP(V). Then ${Forb{F)) = CSP($(V')). 

Theorem 6 may be sometimes reversed: Shadow dualities may be "lifted" 
in case that lifted graphs have colored vertices (this is sometimes described as 
monadic lift) . This is non-trivial and in fact Theorem 7 may be seen as the core 
of this paper. 

Theorem 7. Let r be a finite set of colors and T' be a finite set of T- colored 
digraphs (relational structures), where we color all of the vertices. Suppose that 
<P{Forb{J-')) = CSP{T>) for a finite set T> of digraphs (relational structures). 
Then there exists a finite set V of F-colored digraphs (relational structures) 
such that Forb(F') = CSP{V). 
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4 Proofs 

The proofs of Theorems 3, 4 and 5 are in the full version of this paper [13]. We do 
not include them as they need some new definitions (and space) but nevertheless 
basically follow the strategy of [5]. 

Before proving Theorems 6 and 7 we formulate first a simple lemma which 
we shall use repeatedly: 

Lemma 1. (lifting) Let A,B relational structures, homomorphism f : A — ► 
B, a finite set of colors r and #(B') = B be given. Then there exists a lift A', 

such that 3>(A') = A and the mapping f is a homomorphism A' ► B' (of 

colored structures). 

Proof, (of Theorem 6) Suppose that A e CSP{$(V')), say A e CSP($(T>')). 
Now for a homomorphism / : A — ► <P(T)') there is at least one lift A' of A such 
that the mapping / is a homomorphism A' — > D' (here we use Lifting Lemma 
1). Since the pair (J"', V) is a duality F' -» A' holds for any F' G P and thus 

in turn A G £(Forb(.F'))- 

Conversely, let us assume that A' e Forb(JT') satisfies <P(A r ) = A. But then 
A' G CSP(V) and thus by the functorial property of <P we have A = <P(A') G 
CSP($(V')). 

Proof, (of Theorem 7) Assume <Z>(Forb(J" ')) = CSP{V). Our goal is to find V 
such that Forb(.F') = CSP(V). This will follow as a (non-trivial) combination of 
Theorems 1 and 2. By Theorem 1 we know that if J-"' is a set of (relational) forests 
then the set T' has a dual set V (in the class of covering colored structures; we 
just list all covering colored substructures of the dual set guaranteed by Theorem 
1). It is <P(V) = V by Theorem 6. So assume to the contrary that one of the 
structures, say F , fails to be a forest (i.e. we assume that one of the components 
of Fq has a cycle). We proceed by a refined induction (which will allow us to use 
more properties of Fq) to show that V does not exist. Let us introduce carefully 
the setting of the induction. 

We assume shadow duality <?(Forb(J"')) = CSP{V). Let V be fixed through- 
out the proof. Clearly many sets T' will do the job and we select the set T' such 
that J-' consists of cores of all homomorphic images (explicitly: we close T' un- 
der homomorphic images and then take the set of cores of all these structures). 
Among all such sets T' we take a set of minimal cardinality. It will be again 
denoted by T 1 . We proceed by induction on the size \T'\ of T' . 

The set Forb(.F') is clearly determined by the minimal elements of T' (mini- 
mal in the homomorphism order). Thus let us assume that one of these minimal 
elements, say F , is not a forest. By the minimality of T' we see that we have a 
proper inclusion <?(Forb(jF' \ {F })) D CSPiV). Thus there exists a structure 

5 in the difference. But this in turn means that there has to be a lift S' of S 
such that F — > S' and S -/-> D for every D G V. In fact not only that: as F' Q 
is a core, as Forb(J 7 ') is homomorphism closed and as T' has minimal size we 
conclude that there exist S and S' such that any homomorphism F' Q — ► S' is a 
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monomorphism (i.e. one-to-one, otherwise we could replace F' Q by a set of all its 
homomorphic images - F' Q would not be needed). 

Now we apply (the second non-trivial ingredient) Theorem 2 to structure 
S and an I > X(F )|: wc find a structure So with the following properties: 
So — > S, So — ► D if and only if S — > D for every Del? and So contains 
no cycles of length < I. It follows that So ^ CSP(D). Next we apply Lemma 1 
to obtain a structure S with S — ► S'. Now we use that S is a monadic lift 
and so does not contain cycles of length < t. Now for any F' 6 T' , F' ^ F we 
have F' S as S — ► S' and F' -» S'. As the only homomorphism F — ► S' 
is a monomorphism the only (hypothetical) homomorphism F' — ► S' is also 
monomorphism. But this is a contradiction as F' contains a cycle while S has 
no cycles of length < I. This completes the proof. 

5 Applications 

5.1 Classes with bounded expansion 

We study the restriction of classes $(Forb(F')) to a class of digraphs with 
bounded expansion recently introduced in [20]. These classes are a generaliza- 
tion of proper minor closed and bounded degree classes of graphs. Using the 
decomposition technique of [20] [21] we can prove that any class <P(Forb(J : ')) 
(for a finite set T' of monadic lifts) when restricted to a bounded expansion class 
equals to a CSP class (when restricted to the same class). 

Theorem 8. Consider the finite set of colors r and the class <l>{Forb{!F')) for 
a finite set T' of F-colored digraphs. Let C be a class of digraphs of bounded 
expansion. Then there is a finite set of digraphs T> such that <?(For&(J 7 ')) n C = 
CSP(V)nC. 

Consider a monotone, first-order definable class of colored digraphs C which 
is closed under homomorphism and disjoint union. By a combination with recent 
results of [2] we also obtain (perhaps a bit surprisingly) that the shadow C is a 
CSP language of digraphs. It remains to be seen to which bounded expansion 
classes (of graphs and structures) this result generalizes. 

5.2 The classes MMSNP and FP - a characterization 

We conclude with an application to descriptive theory of complexity classes. Re- 
call that the class of languages defined by monotone, monadic formulas without 
inequality is denoted by MMSNP (Monotone Monadic Strict Nondeterministic 
Polynomial) . (Feder and Vardi proved that the class MMSNP is computationally 
equivalent to the class CSP in a random sense [5], this was later derandomized 
by the first author [12].) Madeleine [16] introduced the class FP of languages 
defined similarly to our forbidden monadic lifts of structures. 

It has been proved in [16] that the classes FP and MMSNP are equal. In fact 
the class MMSNP contains exactly the languages defined by forbidden monadic 
lifts. 
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Proposition 1. A language of relational structures L is in the class MMSNP if 
and only if there is a finite set of colors r and a finite set of T- colored relational 
structures T' such that L = <3>(Forb(T')). 

Madelaine and Stewart [17] gave a long process to decide whether an FP 
language is a finite union of CSP languages. We use Theorems 6 and 7 and the 
description of dualities for relational structures [6] to give a short characteriza- 
tion of a more general class of languages. 

Theorem 9. Consider the finite set of colors r and the language 4>(Forb(J-'')) 
for a finite set T' of F -colored digraphs (relational structures). 

If no F' G T' contains a cycle then there is a finite set of digraphs (relational 
structures) V such that <?(For6(jF')) = CSP(V). If one of the lifts F' in a min- 
imal subfamily of T 1 contains a cycle in its core then the language <P(Forb(F')) 
is not a finite union of CSP languages. 

Proof. If no F' G Forb(T') contains a cycle then the set T' has a dual V 
by Theorem 1, and the shadow of this set V gives the dual set V of the set 
<P(F 'orb{T ')) (by Theorem 6). On the other side if one F' G Forb(T') contains 
a cycle in its core and if T' is minimal (i.e. F' is needed) then Forb(T') does 
not have a dual. The shadow of the language Forb(F') is the language L and 
consequently this fails to be a finite union of CSP languages by Theorem 7. 

Theorem 9 may be interpreted as stability of dualities for finite structures. 
While shadows of the classes Forb(T') are computationally equivalent to the 
whole NP, the shadow dualities are not bringing anything new: these are just 
shadows of dualities. In other words: the coloring problems in the class MMSNP 
are just shadow dualities. This holds for graphs as well for relational structures. 

5.3 On the local chromatic number 

Now we apply Theorem 9 in the analysis of local chromatic number introduced 
in [3] (see also [26]): we say that a graph G is locally (a, 6)-colorable if there 
exists a proper coloring of G by b colors so that every (closed) neighborhood of 
a vertex of G gets at most a colors. It follows from [3] that the class of all locally 
(a, 6)-colorable graphs is of the form CSP([/(a, b)) for an cxplicitely constructed 
graph U{a,b). We conclude this paper with an indirect proof of this result with 
an application to complexity: 

Proposition 2. Let a, b be integers and consider the membership problem for the 
class of locally (a, b) -colorable graphs. This is actually a Constraint Satisfaction 
Problem which is NP-complete ifa,b>3 and it is polynomial time solvable else. 

Proof. Consider the color set _T = {1, . . . , b} and the following set T' of -T-colored 
undirected graphs. Let T' consist of all monochromatic edges (colored by any 
of the b colors) and all the stars with a + 1 vertices colored by at least a + 1 
colors. The corresponding language is exactly the required one: a graph G is in 
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the language iff it admits a proper i^-coloring, this is no monochromatic edge is 
homomorphic to the colored graph, such that the neighbourhood of every vertex 
(including the vertex itself) has at most a different colors, i.e. no star with a+ 1 
vertices of different color is homomorphic to it. Since T' consists of colored trees 
this will be a CSP language by Theorem 9. 

Hell and the second author proved that CSP problems defined by undirected 
graphs are in P if the graph is bipartite and NP-complete else [9]. We do not 
determine which graph defines this particular CSP problem (of locally (a, b)- 
colorable graphs). But if a, b > 3 then we know that it contains the triangle if, 
so the problem is NP-complete. It is easy to see that this membership problem 
is in P if a < 3 or b < 3. 

6 Summary and Future Work 

We found a computationally equivalent formulation of the class NP by means of 
finitely many forbidden lifts of very special type. An ambitious project would be 
to find an equivalent digraph coloring problem for a given NP language really 
effectively (in human sense, our results provide a polynomial time algorithm). 
For example it would be nice to exhibit a vertex coloring problem that is poly- 
nomially equivalent to the graph isomorphism problem. In general this mainly 
depends on how to express the problem in terms of logic. The next class we 
seem to be able to deal with are coloring problems of structures with an equiva- 
lence relation. Another good candidate are lifts using linear order. This promises 
several interesting applications which were studied earlier in a different setting. 

We also proved that shadow dualities and lifted monadic dualities are in 1 — 1 
correspondence. This abstract result has several consequences and streamlines 
some earlier results in descriptive complexity theory (related to MMSNP and 
CSP classes). The simplicity of this approach suggests some other problems. It 
is tempting to try to relate Ladner's diagonalization method [14] in this setting 
(as it was pioneered by Lovasz and Gacs [7] for NPPicoNP in a similar context). 
The characterization of Lifted Dualities is beyond reach but particular cases are 
interesting as they generalize results of [23] [6] and as the corresponding duals 
present polynomial instances of CSP. 

But perhaps more importantly, our approach to the complexity subclasses 
of NP is based on lifts and shadows as a combination of algebra, combinatorics 
and logic. We believe that it has further applications and that it forms a useful 
paradigm. 
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